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SPEED-ADAPTIVE CONTROL SCHEME FOR LEGGED RUNNING ROBOTS 

CROSS REFERENCE TO RELATED APPLICATIONS 
5 This application claims the benefit under 35 U.S.C. §1 19(e) of U.S. Provisional 

Application No. 60/437,703, filed on December 31, 2002, entitled, Speed -Adaptive Control 
Scheme for Legged Running Robots, which is hereby incorporated by reference in its entirety. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH 
10 Not applicable. 

BACKGROUND OF THE INVENTION 
This invention relates to a control scheme for controlling the locomotion of a legged 
robot, and more particularly to a control scheme stabilizing any desired, energetically possible 
15 movement trajectory at any given locomotion speed within a single step of a running monopod 
or other legged robot. 

Legged locomotion aims to move an object in an intended direction. To achieve this goal, 
the system must provide enough energy to compensate for losses within the system (e.g. leg 

20 damping) and with the environment (e.g. air friction). Thus, legged robots require a control, 
which keeps the system energy balanced at a desired level, to reach a steady-state movement. 
However, even with sufficiently controlled system energy, forward locomotion may fail. If a leg 
is not properly aligned with respect to the ground level (e.g. the ground is higher than expected), 
the legged system can stumble or fall over. Thus, legged robots require an additional control, 

25 which keeps an aimed movement trajectory corresponding to the controlled energy level, and 
therefore stabilizes the steady-state locomotion. 

Running is a special form of legged locomotion incorporating ballistic flight phases to 
achieve high forward velocities. As of today, the control of running machines is mostly based on 
30 (or in part based on) the use of a scheme elaborated by Marc Raibert and collaborators (M. H. 
Raibert, "Legged robots that balance", MIT Press, Cambridge, M A, 1986). This control scheme 
decomposes the control of running into three parts: the control of hopping height, forward speed, 
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and posture. It therefore mixes the formerly introduced control of system energy and kinematic 
trajectory. 

Although this decomposed control can result in dynamically stable locomotion, it inherits 
5 several difficulties. First, as it represents an empirical feedback control, it requires the collection 
of appropriate feedback gains. Second, as it presets the legs in one flight phase to a fixed 
orientation, the robot can stumble when encountering lifted ground or obstacles. Third, the 
system requires several steps to stabilize after a perturbation. Lastly, due to the particular control 
of forward speed, the locomotion system spends additional amounts of energy when running 
10 over rough terrain: a lifted (lowered) ground level of one stance phase decreases (increases) the 
forward speed of the running machine, which is compensated by acceleration (deceleration) due 
to the explicit velocity control. This is not necessarily required when the mean perturbation in 
ground level is zero as for uneven terrain of our every day experience, and therefore reduces the 
range of mobility for autonomous legged robots. 

15 

SUMMARY OF THE INVENTION 
This invention provides a control scheme for legged running machines, which is based on 
a decoupled control of system energy and kinematic trajectory (i.e. the separation of kinematic 
and energetic control). 

20 

The present invention yields the appropriate control for any leg operation during the 
stance phase, which is uniquely determined by the landing conditions. It is not constrained to a 
further specified leg operation during stance, and does not require empirically gathering of 
feedback gains. 

25 

In steady-state locomotion, the derived control stabilizes any desired, energetically 
possible movement trajectory at any given locomotion speed within a single step, regardless of 
the system history. This results from a time-variant, sensor feedforward control of the leg 
orientation during the swing phase. It therefore provides maximum flexibility for the legged 
30 running robot. For instance, within one step and without changing the system energy level, the 
legged machine can switch from a smooth run, maximizing the amount of energy put into 
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forward locomotion on even ground (like a paved road), to a bouncy run, maximizing the 
systems locomotion stability in unpredicted, uneven terrain. This flexible control does not 
require acceleration or deceleration of the machine during stance, and can overcome larger 
obstacles or terrain perturbations than control schemes described in the prior art section. 

5 

In accordance with a further aspect of the present invention, a technique for providing 
rotational leg control during a swing phase of a robotic device includes mapping apex heights of 
two consecutive flight phases for different angles of attack, selecting all pairs of leg angle and 
apex heights that result in a desired apex height of a next consecutive flight phase, for each leg 
10 angle-apex height pair, computing the corresponding flight times from apex to touch-down and 
storing dependencies between flight time after apex and leg angle for any desired consecutive 
apex heights. The technique further includes determining an instant of apex during flight phase 
by a vertical take-off velocity and beginning at apex, controlling the angular leg orientation using 
the stored time dependencies for the desired apex height. 

15 

With this particular arrangement, a control technique which does not use instantaneous 
apex height to calculate a leg angle is provided. Rather, in the technique of the present 
invention, the leg rotates continuously after apex until touch-down occurs. According to a 
calculated time series of the leg angle, at any possible instant of touch-down, the appropriate leg 
20 angle is chosen to result in the desired apex height after one contact, independent of the previous 
apex condition. Thus, with this technique, the process of leg rotation becomes a significant 
element of swing leg and the instantaneous flight height (apex height) is not required to stabilize 
a desired trajectory/. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects and advantages of the present invention will be more 
apparent from the following description and drawings, in which: 

FIG. 1 is a block diagram of a monopod robot as an example of a mobile legged robot; 
FIGs. 2A-2D are series of plots of leg force (F L eg) vs. change in leg length (A/) for 

30 different examples of leg operation during stance in steady-state locomotion; 
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FIG. 3 is an explanatory view showing the robot illustrated in FIG. 1 moving with 
alternate flight and contact phases; 

FIG. 4 is an exemplary plot of return maps (yi+i(yi)) of the apex height (y^Ex) of two 
subsequent flight phases (i and i+1) for different angles of attack (ao); 

FIG. 5 is a block diagram of an exemplary control system; 

FIG. 6 is a block diagram of an exemplary control system which illustrates a decoupling 
between energy and kinematic trajectory; 

FIG. 7 is a block diagram of an exemplary embodiment of the leg controller illustrated in 

FIG. 6; 

FIG. 8 is a flow diagram which illustrates the processing performed to control a legged 

robot; 

FIGs. 9A-9E are a series of views illustrating different phases of a movement; 
FIG. 9F is an illustration of a spring-mass model with retraction; 

FIG. 10A is a three-dimensional representation of a return map characterizing spring- 
mass running for different angles of attack; and 

FIG. 10B is a graph of angle of attack versus initial apex height for different desired apex 
heights, respectively. 
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DETAILED DESCRIPTION 
Exemplary embodiments of the invention will now be explained using a monopod robot 
as an example of a legged robot. It should be appreciated that the monopod robot of FIG. 1 is 
5 intended to merely serve as an example of a legged running machine with which the control 
system of the present invention can be used and that the control system of the present invention 
also finds use with a variety of other types of legged running machines. It should also be 
appreciated that numerous details are set forth below in order to provide a thorough 
understanding of the control techniques and related apparatus used to provide robot locomotion. 
10 It should be apparent to one of ordinary skill in the art that variants of the below described 
techniques and apparatus may be used in other embodiments without deviating from the spirit 
and scope of the concepts described herein. For example, the concepts described below can be 
implemented in robots having one, two, three or any number of legs. It should be appreciated 
that in some instances, well-known circuitry is not set forth in detail in order to promote 
15 conciseness and clarity in the description of the figures. 

Referring now to FIG. 1, a lateral view (x, y-plane) of a monopod robot 10 is shown. The 
robot 10 has a body 12 and a leg 14 which are interconnected by a revolute joint 16 driven by an 
electric motor (not shown) and a motion control system 18. The leg 14 is provided having a 
20 distal end coupled to the joint 1 8, a proximal 19 end and a length ("£leg")- 

The operation of the motion control system 18 will be described in detail below in 
conjunction with 3-1 OB. Suffice it here to say, however, that the control system 18 yields the 
appropriate control for any leg operation during a stance phase, which is uniquely determined by 

25 the landing conditions, it is not constrained to a further specified leg operation during stance, 
and does not require empirically gathering of feedback gains. In steady-state locomotion, the 
derived control stabilizes any desired, energetically possible movement trajectory at any given 
locomotion speed within a single step, regardless of the system history. This results from a time- 
variant, sensor feedforward control of the leg orientation during the swing phase. The motion 

30 control system therefore provides maximum flexibility for the legged running robot. For 
instance, within one step and without changing the system energy level, the legged machine can 
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switch from a smooth run, maximizing the amount of energy put into forward locomotion on 
even ground (like a paved road), to a bouncy run, maximizing the systems locomotion stability in 
unpredicted, uneven terrain. This flexible control does not require acceleration or deceleration of 
the machine during stance, and can overcome larger obstacles or terrain perturbations than 
5 control schemes described in the prior ail section. 

When the proximal end 19 of the leg contacts a surface 20 (e.g. the ground) a leg-force 
("Fleg") is generated. The joint 16 is equipped with a position sensor that, when combined with 
a gyroscope, measures an orientation angle a of the leg with respect to the surface 20. The leg 
10 angle a thus describes the leg orientation with respect to the surface 20. 

For simplicity, the leg 14 may be modeled as a passive spring having a stiffness k, 
yielding a repulsive leg response during contact described by a linear leg-force-leg-length 
relationship (denoted as Fleg-^leg) > n steady-state locomotion. An actuator can exert a torque 
15 ("Mleg") on the revolute joint 18, which adjusts the leg orientation during flight and regulates the 
system energy during stance. 

Referring now to FIGs. 2A-2D, different examples of leg operation during stance in 
steady-state locomotion are shown. As should be appreciated, steady-state locomotion in 
20 running requires an energetically balanced, repulsive leg operation, represented by an Fleg-^leg 
relationship that equalizes system energy production and absorption (additional energy 
production required due to air friction is neglected). 

FIG. 2A illustrates a spring-like leg operation (i.e. a linear spring-like response) while 
25 FIG. 2B illustrates a nonlinear spring-like response. FIGs. 2C and 2D illustrate that other leg 
responses are equally possible. 

The leg operation is shown as a (leg-force)-(leg shortening)-dependency F L eg (M) with 
A£(i) = £ 0 - ^LEo(t) and £q is the leg length at touch-down.] 

30 
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Referring now to FIG. 3, a running sequence 30 includes alternate flight phases 32a - 32c 
(generally denoted 32) and contact or stance phases 34a-34b (generally denoted 34) for a 
monopod robot 19' which may be similar to the robot described above in conjunction with FIG. 
1. Robot 19' includes a contact switch or sensor 36 disposed on a distal end 19' of the leg 14' 
5 which detects when the robot leg 14' is in contact with a surface 20 (referred to as a contact 
phase). The actual leg compression may be measured with a position sensor, for example and 
the sensor 36 may include a force sensor disposed on the distal end of the leg to detect the 
contact phase. 

10 The end of each flight phase 32 and beginning of each contact phase 34 are defined by 

respective touchdown points 38a, 38b, generally denoted 38. Similarly, the end of each contact 
phase 34 and beginning of each flight phase 32 is defined by a respective take-off point 40a-40c, 
generally denoted 40. During the flight phases 32, the sensor 36 is off and during the contact 
phases 34 the sensor 36 is on. Thus, the sensor 36 detects the stance phase, during which the leg 

15 angle a (FIG. 1) and the leg length t (FIG. 1 ) are measured. 

At take-off point 40b, the total system energy E T o is given by the vertical position y T o 
and the take-off velocity vto according to: 

E ro = y w + * to<*w ) + m S ' to sin a ro ■ Eq . 1 

20 

As in steady-state locomotion the system energy can be considered constant, the latter one equals 
the energy at take-off E s = Eto This is used to derive the appropriate control for the desired 
movement trajectory. 

25 In contrast to the total system energy E re the instant of the apex relative to take-off is 

merely determined by the vertical take-off velocity v to .y. For any energy E ro and a defined leg 
function (repulsion) during stance (FIGS. 2A-2D), the rotational leg control a(t) during the 
swing phase can be calculated using a return map yi+i(yi, oto) °f the apex height y.APEx- An 
exemplary return map is described below in conjunction with FIG. 4. 

30 
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Kinematic Trajectory Control 

For constant system energy, the stability of the robot locomotion in the movement 
direction is determined by the return map of the apex height of two subsequent flight phases. 
Here, the term "apex' 5 denotes the instant at which the robots center of mass (COM) reaches its 
5 highest point during flight, and the term "apex height 55 is the vertical height yAPEX of the COM at 
this instant. The term "apex return map 55 is the map of any vertical height y\ at apex i to the 
resulting vertical height yj+i at the apex i+1 of the subsequent flight phase caused by the leg 
response during the intermediate contact phase. Besides the leg response in contact, the return 
map is further influenced by the leg orientation ao at touch-down. 

10 

The simplicity of this approach holds as at apex the state vector determining locomotion 
stability reduces to (j^x,y) 4PEX (x has no influence on the system stability), y APEX is zero, and, 

due to the constant system energy E s , x APEy can be expressed by y APEX . 

15 The aim of the kinematic trajectory control is to select a desired, energetically possible 

movement trajectory within one step, and to maintain this trajectory in spite of perturbations in 
ground level or leg response. This aim corresponds to selecting and maintaining a desired apex 
height y control as explained previously. 

20 The appropriate control is derived by estimating the return map yi-i(yi) for all possible 

angles of attack oto, resulting in a generalized return map yi+i(yO|ao. 

Referring now to FIG. 4, a plot of a generalized return map is shown for a monopod robot 
having a passive spring-like leg response during stance with human like parameters of body 
25 mass, leg length, spring stiffness, and system energy. It should be appreciated that an analytical 
description of the leg operation during stance is not known yet and the return maps have been 
estimated by forward dynamic simulation of the monopod robot. 

Thus, FIG. 4 illustrates a schematic plot of return maps yi+i(yi) of the apex height yapex 
30 of two subsequent flight phases (i and i+1) for different angles of attack ao. It should be 

8 



Attorney Docket No.: MIT-143AUS 



appreciated fom FIG. 4 that a desired apex height Ycontrol can be enforced if the angle of attack 
oto is properly adapted to the apex height of the preceding flight phase yj. 

In this representation of the stability behavior of the monopod robot, the 'idealized' 
5 return map projecting any preceding apex height y\ to the desired apex height Ycontrol within 
one step is characterized by the horizontal line yi+i(yi) = Ycontrol- The intersections of this line 
with the return maps yi+i(yi)|oto for various but fixed angles of attack oco uniquely determines the 
angle of attack adjustment ocoCyapex), which is required to project any preceding apex height y\ to 
the desired apex height Ycontrol This angle adjustment at touch-down transforms into a time- 
10 variant feedforward control a(t-tAPEx) starting at the instant of apex tAPEX by using the equation 
of motion of a ballistic flight 

* -tAPex "J-GwK.)- /? oSin« 0 ), Eq. 2 

where £o is the leg length of the monopod robot at touch-down and yAPEx(oto) is the inverse of the 
15 angle of attack adjustment. The instant of apex is estimated by the vertical velocity at take-off 
using 

tAPEX = 1 TO + — = tjO + ~ Sil1 a TO ~ l TO d TO ™S<*To)i Eq. 3 

g g 

and comparing this value with an internal clock. 

20 

Referring now to FIG. 5, a robot system 70 includes a leg controller 72 which receives a 
leg angle input 74, a leg length input 76 and a contact phase control signal 78. The leg controller 
provides a leg rotation control signal 80 and a leg torque control signal 82 to a buss interface 84. 
The buss interface 84 is coupled to an actuator 86 and a motor 88 of a robot 90. The actuator in 
25 86, 88 are coupled to a leg 92 comprising a revolute joint 94 and a leg portion 96. 

The leg angle, leg length and contact phase control signals 74, 76, 78 are provided to the 
leg controller 72 from one or more sensors (not shown in FIG. 5) which sends leg angle, leg 
length and control contact phase of the leg 90. 
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The leg rotation control and torque control signals 80, 82 provided by the leg controller 
will be described below in conjunction with FIG. 6. Suffice it here to say that these signals are 
fed to the actuator 86 and motor 88 which cause the leg 92 to move with predetermined 
5 characteristics. 

As discussed above and as will become apparent from the description of FIGs. 6 and 7 
hereinbelow, the derived control a(t-tAPEx) is independent of the actual ground level at touch- 
down and can be implemented in a leg controller by a look-up table or a real-time calculation 
considering the generalized return map for different levels of system energy E s . Starting at the 
instant tAPEx, the leg controller commands the motor positioning signal a(t-tAPEx), which 
permanently adjusts the leg orientation until ground contact is reached. Ground contact can be 
detected by a sensor (e.g. a force sensor). The sensor may, for example, be disposed on the distal 
end of the leg. 

Referring now to FIG. 6, in which like elements of FIG. 5 are provided having like 
reference designations, the leg controller 72 receives the leg angle signal 74, the leg length signal 
76 and the phase control signal 78 from a sensory input system 96. Sensory input system 96 may 
be provided, for example, from a plurality of discrete sensors which are not in communication 
with each other. Alternatively, sensory input system 96 may be provided from one or more 
sensors one or more of which are in communication with each other. Thus, sensory input system 
96 may be provided as a discrete sensor system, a partially integrated sensor system or a fully 
integrated sensor system. 

25 As sensory input, the measurement of leg angle and leg length is required during stance. 

Additionally, a sensor detects the contact of the leg. Thus, the leg angle signal 74 and the leg 
length signal 76 are generated from a measurement of a leg angle a(t) 100 and leg length <?leg00 
102, respectively, which are made during a contact phase 98. Similarly, the contact phase 
control signal 78 is generated from a contact phase sensor 1 04. 

30 
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In response to the signals provided thereto, the leg controller 72, which is described in 
more detail in conjunction with FIG. 7 below, computes a first control signal 80 corresponding to 
a time-variant leg orientation value (or leg control angle) 1 10 used during a swing phase 108. In 
a preferred embodiment, the swing phase 108 occurs subsequent to the contact (or stance) phase 
5 98 in which the measurements are made. The leg controller 72 also computes a second control 
signal 82 corresponding to a leg torque generation value 114 which is used in a next contact 
phase 112 (i.e. the leg torque generation value 114 is used in a contact phase which occurs after 
the swing phase 108. The leg controller 72 thus calculates the time-variant leg orientation during 
110 in accordance with a desired movement trajectory as well as the necessary torque generation 
10 114 of the joint actuator applied during the following contact phase 112. This approach results 
in a system having decoupled control of system energy and kinematic trajectory. 

Referring now to FIG. 7, in which like elements of FIGs. 5 and 6 are provided having like 
reference designations, the leg controller 72 includes a differentiator 122 which receives the leg 
length and leg angle values 74, 76 from sensors (e.g. position sensors) and provides leg angular 
velocity and leg shortening velocity values 124, 126 to a microprocessor 128. The 
microprocessor 128 also receives the leg length and leg angle values 74, 76 as well as a contact 
phase control value 78 which may, for example, be provided from a force sensor (e.g. sensor 19 
in FIG. 1A). 

The microprocessor 128 is coupled to a memory 132 having stored therein a look-up 
table 134 which holds control values for use in a generalized return map for different levels of 
system energy E s . Memory 132 also includes a parameter storage 136 having stored therein one 
or more values of desired apex height 138 and firmware which can be used to actively compute 
return map values in real time. The microprocessor 128 provides the leg rotational control and 
leg torque control output signals 80, 82 to a bus interface (e.g. bus interface 32 in FIG. 5). 

The system illustrated in FIGs. 6 and 7 estimates (i) the mechanical system energy at 
take-off Eto, and (ii) the instant of apex t A i>Ex within the following flight phase according to the 
30 above equations. Using these two parameters, the rotational leg control ot(t) within the 
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subsequent flight phase and the leg control during the following contact phase are determined 
according Equations 1 - 3 above. 

The energetic losses during flight (air friction) can be taken into account by 
approximating the resultant system energy. However, even for moderate speeds, the losses are 
comparable small and the derived control a(t-t A PEx) for the system energy E s equal to the take- 
off energy Ejo highly suffices to control the desired kinematic trajectory within one step. 

System energy control 

As discussed above, the kinematic control of the present invention is explained on the 
example of a monopod robot with a passive spring-like leg response in steady state. For a given 
system energy Es, this control stabilizes a desired movement trajectory of the running monopod 
robot within one step by adjusting the leg orientation during flight in a feedforward manner. 

A control of the system energy itself is decoupled from the stabilization of the robot 
locomotion and allows for (i) the compensation of the inevitable losses of the legged robot (e.g. 
friction or damping, accumulated during locomotion), (ii) active control of how much energy is 
spent for locomotion (e.g. desired acceleration or deceleration), (iii) the restoration of a desired 
system energy when the robot runs on a lastingly in- or declining surface, (iv) or the like. 

Given the actual system energy Etc at take-off, the difference between the desired 
(Econtrol) and the actual energy determines the amount of energy that has to be supplied (or 
absorbed): 



The electric motor of the monopod robot can exert a torque M on the revolute joint during the 
contact phase, and therefore, can actively de- or accelerate the passive leg rotation due to the 
dynamics of the leg on a freely moving joint (M = 0). Hence, the required change in energy is 
expressed using: 



AE = E t 



CONTROL 



Eq. 4 




Eq. 5 
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5 



For simplicity, the electric motor of the monopod robot can only apply a constant torque during 
the stance phase. Starting at touch-down the required change in energy yields the constant torque 
that has to be applied in the stance phase 

AE AE 
Aa ju{7t-2a 0 ) 

where ao is the angle at touch-down. The constant factor 0 < \i < 1 takes into account that the 
angle Aa swept during stance can be shorter than in steady-state locomotion. A factor p. = 0.5 
guarantees that the sufficient torque is applied when the torque generation starts at touch-down 
10 and stops at an leg angle a(f) = nfl . 

The torque application (Eq. 6) required for the system energy control is implemented in 
the leg controller (see FIGs. 5 - 7). Starting at the instant of touch-down (sensed by the distal 
force sensor), the leg controller commands the electric motor the torque signal Mae,o.5 lasting 
15 until the instant at which the angle a(t) = x/2 is reached (sensed by the angle position sensor). 



Thus, the present invention is applied to any legged robot's control insofar as the control 
decouples into a system energy and kinematic movement trajectory control. 

20 It should be noted that, although the monopod robot is disclosed in the embodiment as an 

example of a mobile robot, the invention will also be applied to two or more legged robot. It 
should further be noted that, although the leg response of the monopod robot disclosed in the 
embodiment is characterized by a passive linear spring, the invention will also be applied to any 
leg operation in stance, which is characterized by a repulsive force response that, in the 

25 movement direction x, is uniquely predicted by the landing conditions (fro, cxtd, v X; td, vy.td)- It 
should further be noted that, although the energy control disclosed in the embodiment is based on 
the application of a torque at the revolute joint (rotational energy control), the invention will also 
be applied to an energy control that is based on the application of axial force of an active leg. 
Here, the required axial force F ax iai for a change AE in system energy can be derived using 

30 Equation 7: 
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AE = \F ad jdt. Eq.7 

It should further be noted that the invention will also be applied to a superposition of axial and 
rotational energy control. Here, the required torque and axial force for a change in system energy 
5 can be distributed according to Equation 8: 

AE = AAE rot +(l-A)AE axial , 0<A<1. Eq. 8 

It should be further noted that, although an angle position sensor and a gyroscope is disclosed in 
the embodiment, the invention will also be applied to any sensory setup, which yields the leg 
10 orientation with respect to gravity. It should be further noted that, although an angle position 
sensor and a leg length sensor is disclosed in the embodiment, the invention will also be applied 
to any sensory setup, which yields the system energy and the instant of apex. It should further be 
noted that, although a force sensor is disclosed in the embodiment, the invention will also be 
applied to any sensory setup, which detects contact and flight phases of the mobile legged robot. 

15 

In running, the spring-like axial behavior of stance limbs is a well-known and remarkably 
general feature. The present invention, however, considers how the rotational behavior of limbs 
affects running stability. 

20 It is commonly observed that running animals retract their limbs just prior to ground 

contact, moving each foot rearward towards the ground. A conservative spring-mass model is 
employed to test the effects of swing-leg retraction on running stability. A feed-forward control 
scheme is applied where the swing-leg is retracted at constant angular velocity throughout the 
second half of the swing phase. The control scheme allows the spring-mass system to 

25 automatically adapt the angle of attack in response to disturbances in forward speed and stance- 
limb stiffness. Using a return map to investigate system stability, an optimal swing-leg retraction 
model for the stabilization of flight phase apex height is proposed. Results indicate that swing- 
leg retraction significantly improves the stability of spring-mass running, suggesting that swing 
phase limb dynamics may play an important role in the stabilization of running animals. 

30 
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In running, kinetic and potential energy removed from the body during the first half of a 
running step is transiently stored as elastic strain energy and later released during the second half 
by elastic recoil. The mechanism of elastic recoil was first proposed in 1964 when it was noticed 
that the forward kinetic energy of the body's center of mass is in phase with fluctuations in 
5 gravitational potential energy. It was hypothesized that humans and animals most likely store 
elastic strain energy in muscle, tendon, ligament, and perhaps even bone to reduce fluctuations in 
total mechanical energy. Motivated by these energetic data, further research led to the proposal 
of a simple model to describe the stance period of symmetric running gaits: a point mass attached 
to a massless, linear spring. Using animal data to select the initial conditions at first ground 
10 contact, it was demonstrated that the spring-mass model can predict important features of stance 
period dynamics. 

Since its formulation the spring-mass model has served as the basis for theoretical 
treatments of animal and human running, not only for the study of running mechanics, but also 

15 stability. In 1999, the stability of hexapod running in numerical simulation was investigated. At 
a preferred forward velocity, a pre-defined sinusoidal pattern of each leg's ground reaction force 
resulted in stable movement patterns. However, the legs could not be viewed as entirely spring- 
like since their force production did not change in response to disturbances applied to the system. 
A later study found a lateral spring-mass stability for hexapod running on a conservative level 

20 where total mechanical energy is constant. However, that study investigated lateral and not 
sagital plane stability in a uniform gravitational field. Also investigated was the stride-to-stride 
sagital plane stability of a spring-mass model. Although the model is conservative it can 
distribute its energy into forward and horizontal direction by selecting different leg angles at 
touch-down. Surprisingly, this partitioning reveals to be asymptotically stable and predicts 

25 human data at moderate running speeds (5 m/s). However, model stability cannot be achieved at 
slow running speeds (< 3 m/s). Additionally, at moderate speeds (< 5 m/s), a high accuracy of 
the landing angle (±1°) is required, necessitating precise control of leg orientation. 

The control strategies described herein enhance the stability of the spring-mass model on 
30 a conservative level. Unlike prior control schemes in which the angle with which the spring- 
mass model strikes the ground is held constant from stride-to-stride, the technique of the present 
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invention relaxes this constraint and impose a swing-leg retraction, a behavior that has been 
observed in running humans and animals in which the swing-leg is moved rearward towards the 
ground during late swing-phase. This controlled limb movement has been shown to reduce foot- 
velocity with respect to the ground, and therefore, landing impact. Additionally, a 
5 biomechanical model for quadrupedal locomotion indicated that leg retraction could improve 
stability in running. It is hypothesized herein that swing-leg retraction improves the stability of 
the spring-mass model by automatically adjusting the angle with which the model strikes the 
ground from one stride to the next. 

10 Spring-mass running with leg retraction 

As discussed in FIG. 3 above, running is characterized by a sequence of contact and 

flight phases. For the contact phase, researchers have described the dynamics of the center of 

mass with a spring-mass model comprising a point mass attached to a massless, linear leg spring. 

To describe the dynamics of the flight phase, a ballistic representation of the body's center of 
15 mass has been used. In the investigation of the stability of spring-mass running, it was assumed 

that the leg spring strikes the ground at a fixed angle with respect to the ground. 

In contrast, an in accordance with the present invention, the orientation of the leg during 
the swing phase is now considered a function of time a(t). For simplicity, a linear relationship 
20 between leg angle (measured with respect to the ground) and time starting at the apex Upex with 
an initial leg angle oir (retraction angle): 



25 where cor is a constant angular leg velocity (retraction speed) is assumed. 

FIG 8 is a flow diagram showing the processing performed by a processing apparatus 
which may, for example, be provided as part of a robot control system such as that shown in 
FIGs. 1-7. The rectangular elements (e.g. block 150 in FIG. 8) in the flow diagram are herein 
30 denoted "processing blocks" and represent steps or instructions or groups of instructions. Some 




Eq. 9 
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of the processing blocks can represent an empirical procedure or a database while others can 
represent computer software instructions or groups of instructions. Thus, some of the steps 
described in the flow diagram may be implemented via computer software while others may be 
implemented in a different manner e.g. via an empirical procedure. 

5 

Alternatively, some of the processing blocks can represent steps performed by 
functionally equivalent circuits such as a digital signal processor circuit or an application specific 
integrated circuit (ASIC). The flow diagram does not depict the syntax of any particular 
programming language. Rather, the flow diagram illustrates the functional information one of 

10 ordinary skill in the art requires to perform the steps or to fabricate circuits or to generate 

computer software to perform the processing required of the particular apparatus. It should be 
noted that where computer software can be used, many routine program elements, such as 
initialization of loops and variables and the use of temporary variables are not shown. It will be 
appreciated by those of ordinary skill in the art that, unless otherwise indicated herein, the 

15 particular sequence of steps described is illustrative only and can be varied without departing 
from the spirit of the invention. 

Turning now to FIG. 8, a process for controlling a legged robot begins by measuring a 
robot vertical take-off velocity as shown in block 1 50. Processing then proceeds to block 152 in 

20 which and estimate time to apex is made from a measure vertical take-of velocity. Processing 
then proceeds to block 154 in which the mechanical energy of the robot is determined. Once the 
mechanical energy is determined, a map corresponding the mechanical energy of the robot is 
selected. Processing the proceeds to block 158 where an instant of apex is used to determine a 
time series of the leg angle to reach a desired apex height in a next flight phase. Processing then 

25 ends for that particular flight/contact phase. Blocks 1 50 - 158 may be repeated for each flight 
and contact phase. 

Referring now to FIGs. 9 A - 9F, a spring-mass model with retraction is shown. Swing- 
leg retraction in running, as indicated by FIGs. 9A - 9E is modeled in FIG. 9F assuming a 
30 constant rotational velocity of the leg (retraction speed cor) starting at the apex of the flight phase 
at retraction angle ocr. Depending upon the duration of the flight phase, the landing angle of the 
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leg (angle of attack oto) is a result of the model dynamics and has no predefined constant value as 
in previous models. The axial leg operation during the stance phase is approximated by a linear 
spring of constant stiffness kLEG- 

5 Stability analysis 

To explore regions of stability during running, a return map is used. A return map is a 
mapping of the system state at a characteristic event within the running cycle. To reduce 
analysis complexity, the apex (i.e., the highest position during the flight phase), is taken as such 
a characteristic event. At this time, the system state (x, y, v\, v y )apex is uniquely identified by 
10 one variable - the apex height yAPEx. This is due to (1) the vanishing vertical velocity 
vy ; apex = 0, (2) the fact that x has no influence on future periodic behavior, and (3) the 
conservative nature of the spring-mass system assuming a constant total mechanical energy. 



As leg retraction is initiated at the apex of the swing phase, the system state at this instant 
15 remains uniquely determined in terms of the apex height y.^PEx- The return map investigates how 
this apex height changes from step to step, or more precisely, from one apex height (index T) to 
the next one (index 'i+T) in the following flight phase (after one contact phase). For a stable 
movement pattern, two conditions must be fulfilled within this framework: (1) there must be a 
periodic solution (Eq. 10A, called fixed point where y^ EX is the steady state apex height) and 
20 (2) deviations from this solution must diminish step by step (Eq. I OB, called asymptotically 
stable fixed point). 

Eq. I OA 



y M = y, = y 



APEX 



Eq. 10B 



<1, 



25 

For simplicity, the subscript "APEX" in yj+i and y\ in this nomenclature is left out. 
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The requirements for stable running can be checked graphically by plotting a selected 
return map (e.g. for a given retraction angle ocr and a given retraction velocity cor) within the (yi, 
yi+i)-plane and searching for stable fixed points fulfilling both conditions. The first condition 
(Eq. 10A, periodic solutions) requires that there is a solution (i.e. a single point) of the return 
map yi+i(yO located at the diagonal (y;+i = yi). The second condition (Eq. 10B, asymptotic 
stability) demands that the slope dy\+\/y\ of the return map yi+i(yO at the periodic solution 
(intersection with the diagonal) is neither steeper than 1 (higher than 45°) nor steeper than -1 
(smaller than -45°). 



As a consequence of the imposed leg retraction, the return map of the apex height yi+i(yO 
is determined by two subsequent mechanisms: the control of the angle of attack oto(yO before 
landing (leg retraction) and the dynamics of the spring-mass model resulting in the following 
apex height yi+i(ao, yi). According to the definition of leg retraction (Eq. 9), an analytical 
relationship between the apex height y.APEx and the landing angle of attack oto exists: 



yAPEx( a o) = 'o sin a 0+| 



r a 0 -a R y 



v 



0), 



Eq. 11 



Here, £o denotes the leg length at touch-down. Merely one branch of the quadratic 
function in oto has to be considered as retraction holds only for t > t A i>Ex according to Eq. 9 
(either oto > ocr, or oto < cxr, depending on the sign of cor). This allows the control strategy 
oto(yAPEx) t0 be derived. 

The running model is implemented in Simulink (The Mathworks, Inc.) using a built-in 
variable time step integrator (odel 13) with a relative tolerance of l.e-12. For a human-like model 
(mass m = 80 kg, leg length <? 0 = 1 m) at different speeds v x (initial condition at apex yo.APEx and 
vo ? apex = v x ) the leg parameters (k L EG, cxr, cor) for stable running are identified by scanning the 
parameter space and measuring the number of successful steps. The stability of potential 
solutions is evaluated using the return map yi+i(yO of the apex height j'apex of two subsequent 
flight phases (i and i+1). Corresponding to a given system energy E, all possible apex heights 0 
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^ yo.APEx ^ E/(mg) are taken into account. To keep the system energy constant, the forward 
velocity at apex v 0 .apex = v\ was adjusted according to the selected apex height yo f APEX with 
m*g yo f APEX + iti/2-(vo.^ex) 2 ~E- For instance, for a system energy E corresponding to an initial 
forward velocity v x = 5 m/s at an apex height yo,APEx = 1 m a range of apex heights between 0 
5 and 2.27 m must be taken into account. 

Referring now to FIGs. 10A and 10B, in terms of the return map of the apex height, an 
'optimal' control strategy can be found by imposing the constraint: 

10 yi+i(yO = y control = constant. 

Within one step this return map projects all possible initial apex heights y\ to the desired 
apex height yi+j = y control- As a consequence of the dynamics of the spring-mass system, the 
apex height y l+ \ is merely determined by the preceding apex height y\ and the selected angle of 
15 attack oto. This dependency i(yi, oto) can be understood as a fingerprint of spring-like leg 
operation and is represented as a surface in FIG. 10A. When applying any control strategy 
ao(yO, this generalized surface yi+i(yi, a 0 ) can be used to derive the corresponding return maps. 

Referring to FIG. 10A, a three-dimensional representation yi+i(yu oto) of the return map 
20 yi+i(yD characterizes spring-mass running (system energy corresponds to v x = 5 m/s at 

yAPEx = 1 m; m = 80 kg, i? 0 = 1 rn, k = 20 kN/m) for different angles of attack oto. For fixed 
angles of attack (slices in 3D), the corresponding return maps are shown on the left (y u yi+i)- 
plane. The red line depicts the return map for oto = 68°. Different return maps are possible if the 
angle of attack oto becomes dependent on the apex height y v 

25 

An 'optimal' control model with respect to stability would be a direct projection of any 
initial apex height y x to a desired apex height ycoNTROiJn the next flight phase, or 
yn-i(yi) = y control = const, as shown for apex heights of 1 , 1.5, and 2 meters (left plane). This 
corresponds to isolines on the 3D-surface yin i(yi, oto) indicating a dependency between the angle 
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of attack oto and the initial apex height y\ as shown for ycoNTROL = U 15 and 2 m in the graph of 
FIG. 10B. The leg retraction model can approximate the optimal control strategy. 

For example, in the case of a fixed angle of attack (no retraction: oto(yO = ot R = const.) the 
5 surface has to be scanned at lines of constant angles oto (FIG. 12 A, e.g., red line: ot 0 = 68°). 

These lines are projected to the left (yi+i,yO-plane in FIG. 10A and match the return map in FIG. 
10A. 

Consider now the 'optimal' control strategy for stable running oto(>'i) fulfilling: 

10 

yi+i(yO = y control = const- 
Using the identified fingerprint, this simply requires a search for isolines of constant y l+ \ 
on the generalized surface yi+i(yi, oto), as indicated by the green lines in FIG. 12 A (yi+i = 1,1.5 
15 and 2 m). The projection of these isolines onto the (oto, yi)-plane represents the desired natural 
control strategy oto(yi) for spring-mass running as depicted for y control = 1, 15, 2 m in FIG 
10B. 

The constant-velocity leg retraction model put forth in this paper represents a particular 
20 control strategy oto(yO relating the angle of attack oto to the apex height y; of the preceding flight 
phase (Eq. 1 1), as shown in FIG. 10B for different retraction speeds (cor = 0, 25, 50, 75°/s) and 
one retraction angle (ot R = 60°). It turns out that this particular leg retraction model can 
approximate the natural control strategy within a considerable range of apex heights if the proper 
retraction parameters (ot R , co R ) are selected. The value of the retraction angle ot R shifts the line of 
25 the retraction control oto(yO along the oto-axis, whereas the retraction speed cor determines the 
slope of the control line. Thus, the retraction parameters have different qualities with respect to 
the control of running; if the retraction speed co R guarantees the stability (setting the range and 
the strength of attraction to a fixed point), then the retraction angle ot R selects the apex height of 
the corresponding fixed point y control- Dut to this adaptability, a constant velocity leg 
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retraction model can significantly enhance the stability of running compared to a swing-leg 
control model that employs a fixed angle of attack. 

Influence Of Speed On The Stability Of Running 
5 The return map discussed in conjunction with FIG. 10A indicates that the generalized 

surface yi+i(yi, (Xo) is sensitive to the running speed. The selected retraction speeds in FIGS. 9 
and 10 (cor = 0, 25, 507s) show that the slope of the return map yi+i(yO increases with decreasing 
running speed. As a consequence, running at 3 m/s with a fixed angle of attack ao = const, is not 
stable (FIG. 10A). However, there exists still a natural control strategy represented by the 
10 isolines of the corresponding generalized surface with y^i (yi, ao) = const, (not shown here). In 
comparison to a fixed angle of attack control, leg retraction is shifted towards this natural control 
(FIG. 10B). Thus, it is a successful strategy to stabilize running below the critical speed 
observed in the fixed angle control. 

15 The analysis reveals that the stability of spring-mass running is highly sensitive to the 

angular velocity of the leg before landing. However, due to the simplicity of the approach, we 
cannot exclude that alternative strategies could be crucial for stable running (i.e. leg retraction 
could be the biological way of stabilizing running). 

20 An experimental study on obstacle avoidance during walking found that subjects used 

visual information (e.g. obstacle placement and size) selecting the proper kinematic program to 
cope with such environmental disturbances. In literature only few studies are available on 
possible control strategies tor stable running. One investigated regulatory mechanisms to secure 
proper footing. Therefore, it studied subjects running on a treadmill on irregularly spaced 

25 targets. To hit the targets step length was modulated by increasing the vertical impulse during 
stance phase using visual perception. This indicates that vision is important, however, it remains 
unclear, to what extent mechanical or neuro-muscular mechanisms may contribute to stabilize 
running over uneven ground without footing constraints. 

30 For instance, the intrinsic properties of muscle lead to immediate responses to length and 

particularly velocity perturbations. Since this behavior depends on the muscle activation and, 
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consequently, on the neural control scheme it is called "preflex." One an analytical study 
showed that a self-stabilizing oscillatory leg operation emerges if well-established muscle 
properties are adopted. This suggests that during cyclic locomotory tasks as walking or running 
the system could counteract disturbances in the stance phase. 

5 

Taking the dynamics of the muscle-reflex system into account, spring-like leg operation 
as observed in running or jumping tasks can be achieved, if a positive feedback of the muscle 
force sensory signals (Golgi organs) is employed. Within such a framework the leg stiffness is 
not a passive systemic property anymore, but is actively modulated (e.g. central drives, 
10 intermuscular reflex pathways). Moreover, the actual leg stiffness is not a determined 

mechanical parameter but the expression of an energetically equalized neuro-muscular dynamics 
on the leg level. Consequently, the leg function during stance phase is energetically and 
dynamically stabilized resulting in a uniform pattern of the ground reaction force as observed in 
human and animal running. 

15 

At this point two complementary control strategies for running can be deduced: (1) flight 
phase control and (2) stance phase control. In the former, a trajectory disturbance results in an 
adapted landing condition (e.g. angle of attack). Leg retraction is such an approach improving 
stability. In the latter strategy, a changed initial landing condition leads to an adapted dynamic 
20 leg response (e.g. leg stiffness). Higher landing velocities could imply an accelerated force built- 
up (eccentric force enhancement) and, consequently, an increased leg stiffness. 

An experiment on human running is designed to evaluate the relevance of these two 
alternative approaches. An instrumented treadmill is equipped with an obstacle machine 
25 consisting of a light plastic bar moving synchronized to the belt at I 2 cm above the ground. The 
obstacle is triggered by the ground reaction force and randomly released every 9-16 seconds. 

It should be appreciated that experimental results suggest that the leg operation during 
stance phase mainly provides a dynamically consistent behavior which stabilizes the system 
30 energy (to regain the required running speed after disturbance), whereas the leg kinematics prior 
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to landing stabilizes a desired trajectory of the center of mass. The actual solution may depend 
on the subjects experience to cope with varied running conditions. 

i 

Leg retraction is a feedforward control scheme and, therefore, can neither avoid obstacles 
5 nor place the foot at desired targets. It rather provides a mechanical background stability, which 
relaxes the control effort for the locomotor/ task, and allows the system to concentrate on higher 
objectives. 

The swing leg kinematics during protraction must be tuned corresponding to the available 
10 environmental information (e.g. visual, cutaneous). It remains for further research to understand 
to what extent the intrinsic properties of the swing leg allow for varied kinematic trajectories 
without loosing the stabilizing effects of leg retraction. 

Future investigations are necessary to fully understand the impact of late swing phase 
15 retraction on animal stability. To gain insight into the control scheme used by running animals, 
the natural retraction control formulated herein may be compared to actual limb movements 
measured on running animals. Still further, since the spring-mass model of this study is two- 
dimensional, it may be desirable to generalize retraction to three dimensions to address issues of 
body yaw and roll stability. And finally, optimized retraction control schemes may be tested on 
20 legged robots to enhance their robustness to internal (leg stiffness variations) and external 
disturbances (ground surface irregularities). 

In sum, swing-leg retraction can improve the stability of spring-mass running. With 
retraction, the spring-mass model is stable across the full range of biological running speeds and 
25 can overcome larger disturbances in the angle of attack and leg stiffness. In the stabilization of 
running humans and animals, swing-leg retraction is an important control consideration. 

All references cited herein are hereby incorporated herein by reference in their entirety. 

30 Having described preferred embodiments of the invention, one of ordinary skill in the art 

will now realize further features and advantages of the invention from the above-described 



24 



Attorney Docket No.: MIT-143AUS 



embodiments. It should be understood, therefore, that the foregoing is only illustrative of the 
principles of the invention and that various modifications can be made by those skilled in the art 
without departing from the scope and spirit of the invention. Accordingly, the invention is not to 
be limited by what has been particularly shown and described, except as indicated by the 
5 appended claims. 

What is claimed is: 



25 



